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ABSTRACT 

A method for optimal reduction of data taken with multi-fiber spectrographs is described, based on global 
correction of their geometrical distortion. Though it was specifically developed for reducing observations 
performed at Palomar Mountain using the Norris fiber spectrograph, this method can be adapted to other 
types of multi-object spectrographs such as the multi-slit ones. Combined with a 2D analytical interpolation 
of sky-background that accounts for non-uniform spectral resolution, the Norris software package achieves very 
high accuracy in airglow subtraction, even in the near infrared (7000-9000 A) where molecular band-emissions 
commonly induce strong artefacts that preclude clean sky subtraction whenever standard image processing 
techniques are used. Correlatively, an improvement by a factor of 2 on the precision of radial velocities is 
achievable. Throughout the paper possible improvements to the method are suggested for those devising 
similar packages for other instruments. 

Subject headings: instrumentation: spectrographs, techniques: image processing, method: analytical 


1. Introduction 

In the last decade, multi-fiber spectrographs have 
opened a new era for performing efhcient surveys of large 
and homogeneous samples of faint celestial sources. Com¬ 
bined with modern, large-format high quality CCDs, such 
systems allow (or will allow in the near future) simultane¬ 
ous spectroscopy of sometimes as many as « 1000 sources 
over fields of « 1 square degree, that is «l-2 orders of 
magnitude more than is possible with multi-slit systems. 
However, two principal drawbacks of this powerful tech¬ 
nology arise from: 

1. The inevitably significant distortion of spectra over 

the CCD area, a property in common to all types 
of multi-object spectrographs. This distortion com¬ 
monly results from : (i) the off-axis incidence of 

beams on the grating, thus inducing conical disper¬ 
sion; (ii) the focusing optical components (collima¬ 
tor, imaging objective, etc). 

2. The poor performance of sky subtraction techniques 
in multi-fiber spectrographs, commonly resulting 
from: (i) the use of a limited number of sky fibers 
surrounding astronomical ones; and occasionally (ii) 
non-flatness of the CCDs. With little effect on distor¬ 
tion itself, this last cause can however be responsible 
for important variations in the bidimensional (2D) 
resolution, as shown in Sect. 3. 


Thorough analyses of various sky subtraction tech¬ 
niques applicable to fiber spectrographs and their capa¬ 
bilities to provide satisfactory signal-to-noise (S/N) ratios 
for very faint sources have been presented in several papers 
in the past decade, and useful references to them can be 
found in, for example, Lissandrini et al. (1994) and Wyse 
& Gilmore (1992), two of the most recent articles on the 
subject. However, as emphasized in particular by Wyse 
& Gilmore, their precepts apply generally to “spectra al¬ 
ready extracted from 2D raw data, after appropriate in¬ 
strument specific pre-processing.” Generally, the latter re¬ 
lies on use of a standard method for correcting the marked 
distortion of large 2D-images, that is to say by fitting 
polynomials first to the transverse distortion of each spec¬ 
trum, and then to the longitudinal (or dispersive) distor¬ 
tion with simultaneous conversion into wavelength units. 
And more critically, the coefhcients of such fitted polyno¬ 
mials are allowed to be independent^ i.e. not constrained 
to vary smoothly across adjacent spectra despite this be¬ 
ing expected on physical grounds. So, when compounded 
with a resolution that normally varies across the field, this 
method usually leads to dramatic sky-subtraction residu¬ 
als, especially in the red region of airglow emission over¬ 
crowded with intense OH lines. In addition, any instability 
in the geometrical distortion correction obviously results 
in uncontrolled systematic errors in the velocities derived 
from spectral lines. 


In the course of spectroscopic follow-up of UV-excess 
sources detected at 2000 A around the extragalactic cluster 
Abell 2111 by the balloon-borne FOCA experiment (Mil¬ 
liard et al. 1991), we have been using the Norris multi-fiber 
spectrograph at Palomar Mountain Observatory. Because 
of the bright infrared sky, previous users of this instrument, 
such as for example Small et al. (1997, hereafter SSH) 
did not attempt observations at wavelengths above 6500 A 
where the adopted standard sky subtraction techniques 
proved quite unsatisfactory for fiber spectroscopy. Our 
first attempts at reducing our early data collected in 1995 
this way confirmed that high-intensity residual “grass” ef¬ 
fectively forbade identihcation of even moderately strong 
emission lines above 7000 A, while the spectral domain re¬ 
quired for our extragalactic program was ~ 3800 — 9000 A. 

Investigation of the phenomenon soon suggested that it 
could result mainly from a combination of (i) insufficient 
accuracy in the wavelength calibration using independent 
fiber-to-fiber polynomial Hts, as mentioned above, and (ii) 
poor estimation of the precise sky spectrum to be sub¬ 
tracted from each fiber, because of the marked variations 
in resolution (~ 3 — 5 pixels) across the field, which es¬ 
sentially resulted from the non-flatness of the CCD used 
with the Norris spectrograph. Simulations show that both 
effects induce unacceptable artefacts in the sky subtrac¬ 
tion (5 to 10% of line peak intensity), when shifts in the 
position of lines or errors on the PSF width reach 0.05 or 
0.1 pixel respectively. 

So, we decided to spend time devising a special software 
package (based on specially written MIDAS procedures and 
FORTRAN subroutines) permitting an improved sky correc¬ 
tion, thanks to (i) a 2D analytical model of the spectro¬ 
graph’s optical system that provides an accurate correction 
of the global distortion; and (ii) a 2D empirical model of 
the sky background contribution that ensures a reduced 
noise level by accounting for the non-uniform spectral res¬ 
olution. This was non-trivial and hence the mathematical 
formulation of the algorithm has evolved markedly over 
the 3 years of data collection, leading to improved quality 
output spectra, which now show good S/N ratios even at 
their very red limit. 

The multi-slit spectrographs are in principal free of such 
effects, at least in the ideal case where the slit length is 
much larger than the astronomical object. However, this 
condition is not always fulfilled during realistic observa¬ 
tions, because maximizing the science return most often 
implies minimizing slit length to avoid overlapping spec¬ 
tral images. Hence, the accuracy of sky subtraction can 
be much reduced for such objects as well resolved galaxies 
or close galaxy pairs that are frequently revealed by spec¬ 
troscopic follow-ups of deep imaging surveys. A global 
correction of the distortion and of the 2D sky contribution 
in multi-slits spectrograms may then improve the overall 
quality of the derived data, even using a model of the dis¬ 
tortion simpler than described in this paper. 


We know that some teams (North et al. 2000)^ are al¬ 
ready working on methods and software packages similar to 
the ones presented here. Although marked variations exist 
in the design of the multi-object spectrographs attached to 
the world’s large aperture telescopes, we are confident that 
other people will be interested in adapting our method to 
their specific instruments, since in addition to spectra of 
much higher quality (which observers will fully appreciate), 
engineering teams can obtain better knowledge concerning 
the true limits of their spectrographs, as shown below. In 
this paper, we briefly report our observational technique 
at Palomar in Sect. 2 and detail the modeling of the Norris 
system in Sect. 3, while Sect. 4 provides a short discussion 
of the performance and limits of our method, together with 
recommendations for further improvements. 

2. The Norris observations 

The optical spectra of the UV-selected objects were ob¬ 
tained with the Norris multi-Hber spectrograph mounted 
at the Cassegrain f/16 focus of the Hale 5m telescope. The 
observations were performed over 5 nights (out of a total 
allocation of 7) from 1995 to 1997. This spectrograph has 
been extensively described by Hamilton et al. (1993, here¬ 
after Hetal) and was originally designed to position a max¬ 
imum of 176 Hbers (as close as 16") in a circular Held of 
20' diameter, using a 2048x2048 CCD with 27/im pixels. 
However, our observations were carried out using the new 
Tektronix/SITe 2048x2048 thinned, backside-illuminated 
CCD (hereafter “CCD13”) with 24/rm pixels, which only 
enables wlhO fibers to be imaged. This was no disadvan¬ 
tage for our programme since the number of UV-detected 
sources in a 20' circular field is normally < 50. In fact, 
this has allowed us to improve the science return in sev¬ 
eral ways, in particular by assigning typically 20-35 sky 
fibers per field, from which accurate 2D fits of the night sky 
contribution to the observed spectra could be derived (see 
Sect. 3 below). Note that the images taken with CCD13 
consist of spectra with a mean FWHM of 4 pixels and 
spaced by 12 to 13 pixels. 

The wavelength range for our 3 years of observations 
was ~ 5150 A wide, with edges near 3800 A and 9000 A but 
with minor shifts (~ 50 — 70 A) from year to year. This 
very wide spectral domain was obtained using a 300 line 
mm“^ grating, with a lower wavelength limit requirement 
of observing not only the [O ii] 3727 A emission line of low- 
redshift field galaxies, but also the Can K (3933A) and 
H (3968 A) absorption lines with virtually zero redshift, 
since « 30% of the UV-detections were expected to arise 
from galactic stars, as was confirmed by follow-up. With 
this grating, the dispersion was ~0.39 pixel A“^ but the 
spectral resolution varied from ~ 7 to 12 A FWHM over 
the field, mostly due to a marked non-flatness of CCD13 
(see Sect. 3.2). Note also that the blaze angle being well 

^ http: / / obswww. unige.ch/Instruments / GIRAFFE / 



optimized for these observations, no filter was needed to 
separate orders 1 and 2 over the spectral domain. 

A nominal sequence of observation on a given 20' sub- 
field normally included two exposures of 50 — 60 minutes on 
the sky to facilitate cosmic ray removal, and each exposure 
was bracketed by 2 of the 3 short exposures taken during 
the sequence with an FeAr arc for wavelength calibration. 
Flat-fielding was obtained through dome-flats taken with 
the telescope at the zenith, and using the “undithered” 
spectrograph mode (see SSH for details concerning the 
poor results obtained using the dithered mode, in which 
the collimator is moved back and forth perpendicularly 
to the dispersion). However, CCD13, which we and SSH 
have used, is so uniform in sensitivity that little damage 
was expected a priori from minor shifts due to instrumen¬ 
tal flexures in the position of spectra on the chip. Note 
that the effects of flexure on different parameters of the 
spectrograph are provided as a by-product of the method 
used for correcting the geometrical distortion (see below). 
For example, for the range of declinations that we have 
been using (-1-29° ^ S < -1-43°), the maximum shifts from 
the zenith (where dome-flats are taken) to hour angles as 
large as 60° remain < 1 pixel (consistent with the Spectro¬ 
graph Manual at Palomar), to be compared with the mean 
4 pixel FWHM of the Norris spectra. 

Note that we have accounted for (i) the relative flux 
calibration using a standard star, (ii) the continuous tel¬ 
luric extinction at Palomar using the calibration of Hayes 
& Latham (1975), and (iii) the molecular-band absorp¬ 
tions above 5500 A using one of the program stars with 
low metallicity. More importantly for the present paper, 
though no velocity standard was observed, 58 galactic stars 
were identified around Abell 2111, the radial velocities 
of which have revealed (in addition to high-velocity halo 
stars) a population of disc and thick-disc objects with a 
mean velocity relative to the LSR close to zero, thus in¬ 
dicating that the derived velocities are of sufficient relia¬ 
bility for the needs of our programme. A further check 
was provided by 7 stars from another survey programme 
carried out at the same time around the globular cluster 
Messier 92: 3 of them obviously belong to the cluster and 
show a mean difference of —(10±26)kms“^ relative to the 
known heliocentric velocity of the cluster (—121kms“^), 
a value not statistically different from zero (see Sect. 4 for 
further information derived from spectra of galaxies). 

It is here worth mentioning a positive aspect of fiber 
spectroscopy compared to classical slit or multi-slit spec¬ 
troscopy, where precise centering of sources is mandatory 
to avoid large errors in the derived velocities. Fibers nor¬ 
mally eliminate such effects because the large number of 
internal reflexions lead to an angular output distribution 
of the beam highly “thermalized” relative to the input, 
that is, with no memory of any mis-centering of the input 
beam. 

In both cases however, errors in relative flux calibra¬ 


tion vs. wavelength remain a major problem when differ¬ 
ential atmospheric refraction induces variable vignetting as 
a function of wavelength, and this applied to our follow-up 
since no atmospheric dispersion corrector was available at 
the Cassegrain focus of the Hale telescope. The correct po¬ 
sitioning of the fibers therefore requires calculation of the 
refraction for the planned observation time. The represen¬ 
tative wavelength at which this calculation is done must be 
chosen so as to equalize the chromatic offcentering at the 
two ends of the spectral domain. For the one we used, this 
optimal wavelength was ~ 4800 — 5000 A, but theoretically 
it is also a strong function of the ratio of the fiber width 
to the seeing. 

Another observing constraint of critical importance at 
Palomar was to accurately check the centering of guide 
stars relative to several bright programme stars at the very 
beginning of each observing session, because of possible 
errors in the equatorial coordinates of the guide stars. Due 
to time constraints, this check was not performed for one of 
the subfields in 1996, which resulted in a sensitivity loss of 
«l-2 magnitudes for some stars, but remained acceptable 
for extended objects such as galaxies (a main goal for our 
follow-up of UV-detected sources). 

3. Modeling the Norris system 

In this section, we show how the geometry of the Nor¬ 
ris system was used to derive the analytical formalism 
adopted for correction of the 2D spectrograms, and how 
the algorithm was applied. In addition to the homoge¬ 
neous quality of results that one can expect from a global 
transformation of input data, this method also implies that 
images are resampled in only two steps (the 2D-correction 
itself, followed by wavelength rebinning of all ID-spectra to 
a common scale. Sect. 3.3), thus ensuring maximum con¬ 
servation of the precious local S/N ratio and preserving 
spectral resolution. 

With the aim of providing a general method for ana¬ 
lytical modeling of various multi-object spectrographs, we 
give separate analyses for the different components of dis¬ 
tortion (due to collimator, grating and camera) and the 
markedly variable 2D-resolution experienced on the Nor¬ 
ris frames. While the former should adapt easily to other 
instruments whenever their optical layout is comparable 
to Fig. 1 (upper diagram), the latter is more specific to the 
Norris spectrograph, and a different formalism may be re¬ 
quired in other cases (for example: a reversed situation in 
which most of the variable resolution comes from the cam¬ 
era optics itself, instead from CCD non-flatness, as here). 

3.1. Basic geometrical formalism 

For the reader’s convenience, the upper diagram of 
Fig. 1 partially replicates a meridian cut of the Norris opti¬ 
cal train given by Hetal (their Fig. 3), in which a flat grat¬ 
ing is placed near the center of curvature G of a spherical 
collimator mirror, while the fiber bundle (or fiber slit) is 



placed at the collimator’s focus F. The bundle is convex 
towards the spherical mirror as in any Schmidt design, and 
theoretically oriented perpendicular to the plane of the fig¬ 
ure. At the focal ratio of beams exiting from fibers (« 4), 
spherical aberration of the collimator is negligible. The 
parallel beams dispersed by the grating are then focused 
onto the CCD by a high-luminosity lens (Epps camera, see 
Hetal for details), the optical axis of which intercepts the 
CCD at point C. 




Fig. 1.— Upper: simplified meridian cut of the Norris 
optical train. Lower: sketch of the corresponding spherical 
triangles used for geometrical modeling. 

We must emphasize that G has been implicitly assigned 
to the camera’s optical axis in our modeling of the sys¬ 
tem, which of course should be inexact in practice, and 
this might explain (at least partly) why (i) the position of 
C was found at pixel coordinates Xc — 1015, pc — 1000 
(instead of 1024, 1024 ideally); and (ii) some discrete, high- 
order and non-axisymmetric terms had to be introduced to 
correct small, but obvious residual trends in the observed 
distortion (at the level of > 0.1 pixel). However, another 


possible source of asymmetry will be mentioned below. 

The lower diagram of Fig. 1 provides a sketch of various 
spherical triangles involved in the derivation of trigonomet¬ 
rical formulae detailed below or in Appendix A. Ideally, the 
focal plane should be normal to GC at point C with the 
abscissae of spectra increasing along Cx and wavelengths 
along Cy. Similarly, a parallel beam from a given fiber A 
is incident on the grating with field angle (p = FGA, and 
the fiber bundle is theoretically perpendicular to GF as 
mentioned above. 

In the preliminary model devised for correcting the first 
series of spectra (from 1995), we had also implicitly as¬ 
sumed that the normal to grating, GN, belonged to merid¬ 
ian plane GGF, with angles a = NGF and (3 = NGG ac¬ 
counting respectively for the angle of incidence of the col¬ 
limated beam onto the grating and the angle of emergence 
for what is hereafter called the “central wavelength” Ac. 
Notice that so defined, a > 0 but /3 < 0 in Fig. 1. By me¬ 
chanical construction, we have a — /3 = 35°, but a value of 
34° was erroneously adopted in 1995 and taken fixed in all 
versions of the software package. Analytical simulations 
show that the effect of this mistake is negligible on the 
wavelength distortion, but its possible contribution to the 
slight asymmetry of the chromatic distortion mentioned at 
the end of this section has not been checked. 

The second series of spectra (from 1996) actually re¬ 
vealed a weak but continuous variation of the residual dis¬ 
persion with X, leading us to suspect that the true normal 
to the grating, GNi, did not lie in meridian plane GGF, but 
in a plane IGFi inclined at angle i (taken > 0 in Fig. 1) to 
plane GGF. With bothj)lanes intersecting along a line GI 
such that angle ui = IGC, cardinal points P,C,N,F of the 
theoretical optical system are transposed to Pi,Ci,Ni,Fi 
with point Ci defined as lying in plane PGG, which is 
perpendicular to meridian plane GGF. Angles o, [3 now 
become o', (3' while (/?' = FiGA is the true input field an¬ 
gle of fiber A, and F)^, A' the focal plane images of Fi, A 
for wavelength A. 

By virtue of the conical dispersion law, we have also 
F'^GA' = ip' while the true output dispersive angle is s' = 
CiGF( such that : 

knX = cos ip' [sin a + sin(£' + (3')] (1) 

with n = 300 lines/mm and k = 1. We omit k in what 
follows to simplify the formulae. Because our definition for 
central wavelength Ac implies : 

if' = £' = 0, 

n Xc = sina'-I-sin/3', (2) 

both dispersion formulae can be merged into a single one: 

n (A — Ac cos ip') + sin f3' cos p' = 
sin (3' [cos ip' cos s'] + cos (3' [cos p' sin s'] (3) 






in which the two terms in brackets on the right-hand side 
depend on coordinates xy, the focal length / of the camera, 
and angular parameters. However, the full derivation is 
somewhat complicated, so we detail it in Appendix A. It 
leads to the condensed parametric formulae: 


essentially of degree 2 (Hetal). In addition, further 
analysis led us to suspect that the degree-4 term re¬ 
sulted from CCDlS’s non-flatness, which has little 
effect on distortion itself, but deep implications for 
the sky-background subtraction. 


y = Aisinip'i^l +^ + A2 j + A3, 

1 ^ Bi^l + ^[n{X- Xc cos (f') -I- sin /?' cos (/?'] 

B2 — + B3. ( 4 ) 

Here p = x'^ + is the distance between points A' and 

C, and An,Bn are parameters which depend on angular 
variables only. Given that i is normally expected to be 
very small, the exact formulae of Appendix A are well ap¬ 
proximated by their first order terms: 

Ai ~ — 1 A 2 — i costa A 3 ~ f sinta, 

Bi ~ -— i ?2 ~ —i (sinca tan/3' -|- costa), 

cos p' 

i 33 ~—tan/3' (5) 

from which decisions on which way and by how much each 
of them has to be modified become obvious once a given set 
of parameters has revealed itself unsatisfactory and resid¬ 
ual trends have been identified (see Appendix B for typical 
values of the parameters). 

So far, we have analyzed the main components of geo¬ 
metrical distortion due to the collimator and the grating. 
However, early inspection of distortion-corrected FeAr cal¬ 
ibration images revealed three minor additional effects : 

• a slight, linear increase of ordinates y (dispersive 
axis) vs. abscissae x for fiber images for any given 
wavelength, thus implying a non-orthogonality of the 
fiber slit to meridian plane CGF, or a grating rota¬ 
tion in its plane, by an amount of w 15 — 20'. 

• a slight, linear variation of the apparent focal length 
/ (or dispersion) with abscissae x, also implying a 
tilt of the fiber slit in plane PGF of « 13'. 

Both effects have been simply accounted for by parameters 
with dimensions of slopes (respectively SLOP and tilt, see 
Appendix B). Interestingly, it transpired that their values 
varied slightly with telescope position on the sky, in a way 
consistent with differential flexure of some component in¬ 
side Norris. 

• a marked trend of residual distortion vs. radial dis¬ 
tance from point G, which is well approximated by 
a degree-4 polynomial in p. An initial assumption 
was to suspect a dominant contribution from the 
camera’s own distortion, but this proved inconsis¬ 
tent with later information that its distortion law is 


Modeling of the camera’s distortion proved the most 
critical point of the method, and certainly the most subject 
to marked evolution in its mathematical formalism over 
the 3 years of data reductions. The formulae presented 
here are the final solutions adopted on the basis of critical 
information reported by Hetal in particular. They consist 
first in a coefficient for radial distortion ATd and second 
in a chromatic term K\. Ko was written as a polynomial 
function of the field angle of beams exiting from the camera 
lens expressed through its tangent p/ f: 

4 

Xo = 1 + E Ou{p/fr (6) 

n—l 

since theoretically this is a better representation than us¬ 
ing a dependency on p alone, given that focal length / can 
vary slightly over time for various reasons (instrumental 
setup, flexure and/or thermal gradients). However, for our 
observations with the Norris spectrograph, / was found to 
vary by only w 0.13% peak-to-peak and hence this formu¬ 
lation might be seen as unnecessarily finicky. The values 
derived for the 0„ coefficients confirm a dominant contri¬ 
bution (> 97%) from the degree-2 term, and the overall 
contribution of the camera accounts for Ap ~ 4-14 pix¬ 
els at the extreme corners of the field, i.e. most of the 
observed distortion. 

It was found necessary to include the chromatic term K\ 
as an additive term to ATd, this is ascribed to the intrinsic 
chromatism of the camera. It was arbitrarily accounted for 
by a degree-5 polynomial with numerical coefficients that 
were derived from fits to residual trends. Note that the 
maximum contribution observed for Kx was « 0.6 pixel in 
X and w 0.4 pixel in y. Though such values are roughly 
consistent with data reported by Hetal, a possible cause 
for this asymmetry has been mentioned above. 

3.2. Variable resolution and true sky-background 

Numerical data on the 2D-profile of CCDlS’s “bump” 
kindly provided by T.A. Small (1997, private communica¬ 
tion) prompted us to think that the bump might be simul¬ 
taneously responsible for (i) most of the marked variations 
observed in the x and y linear resolutions; and (ii) most of 
the degree-4 trend in p mentioned above. Analytical mod¬ 
eling confirmed that the bump is not symmetrical, but can 
be acceptably approximated by elliptical contours oblate 
in y, with an axial ratio ~ 0.87 and a center at pixel coordi¬ 
nates x^ ~ 1000±2, 2 /p ~ 1196±10 (standard errors on the 
mean), a fair distance away from point C. Combined with 
the slightly curved focal plane of the camera (< 50/rm) 
but in the opposite sense according to Hetal (the CCD 



bump being convex towards camera lens), the global am¬ 
plitude of « (320 ±20) fim (i.e. 12-14 pixels) derived from 
our modeling is quite consistent with a contribution from 
CCD13 of w 280 fxm measured by T.A. Small. 

Focusing of the Norris spectrograph itself is achieved by 
moving the collimator, and focus adjustment is performed 
at the beginning of observing sessions. The best compro¬ 
mise consists of course in roughly equalizing the intra- and 
extra-focal amounts of defocus, which normally correspond 
to a locus of best focus with a radius of « 800 — 900 pix¬ 
els, where the FWHM of the point spread function (PSF) 
is at a minimum of ~ 3.1 pixels; while the FWHM typi¬ 
cally reaches w 5 pixels at the bump center or at the CCD 
corners. 

Tests showed that in addition to a nearly constant term, 
an even polynomial of degree 4 with constrained coeffi¬ 
cients was sufficient to account for the varying FWHM 
w{x,y) due to this effect, that is: 

w{x,y) X pl{l-+c{x,y) (7) 

in which Rp refers to the radius of an ideal circle, centered 
at pixels coordinates Xp,yp, around which focusing would 
be best. As mentioned above, this locus being neatly ellip¬ 
tical, Pp has been formulated so as to include a factor hy 
(> 1 hereafter) for homothetic transformation along the 
y-axis, such as: 

pI = {x- Xpf + hlx {y - ypf . ( 8 ) 

The “nearly constant term” c{x, y) has actually been fitted 
by a plane, i.e. ci ± C 2 X ± c^y, with very small values 
observed for C 2 and C 3 , corresponding to non-orthogonality 
of the mean CCD plane with respect to the camera optical 
axis by « 15" (a quite satisfactory figure, though probably 
meaningless in terms of true optical misalignement given 
the irregular shape of CCD13). 

Notice that this formulation for w{x,y) implies (i) that 
7 < 0 and hence c{xp, yp) is accounting for the width of the 
PSF at the bump’s center; and (ii) that the global shape of 
the curved CCD13 surface is close to an oblate paraboloid, 
which is far from being realistic according to the data on 
its true shape. So, the formulation adopted here leads to a 
model PSF width which is systematically in error in some 
areas of the field (see Sect. 4). 

As emphasized in Sect. 1, marked variations in the 2D- 
resolution of multi-object spectrographs can be responsible 
for dramatic losses of accuracy in the subtraction of sky 
backgrounds, and this whatever the method used for op¬ 
timal subtraction, if interpolation of the background does 
not account for local variations in the PSF. In addition, 
it can be shown that whenever the monochromatic PSF 
remains approximately Gaussian (which applies to Norris 
spectra, with nearly the same FWHM values in x and y), 
slight loss of focus induces variations in local intensities 
which are also well accounted for by an even polynomial 


of degree 4 with the same formalism as the first term in 
Eq.7. 

The four shape parameters {xp, yp,Rp,hy) were used in 
a FORTRAN subroutine (spfndfib, see Fig. 2) for interpo¬ 
lating sky-fibers’ intensities row by row. However, given 
the limited number of sky fibers and the potentially low 
S/N ratio of faint signals, spurious intensity values were 
eliminated iteratively by automatic weighting for each row. 

3.3. Method of reduction and software applica¬ 
tion 

As mentioned in Sect. 1, we have been using the MIDAS 
package (more exactly the old 1994 version for VMS a- 
stations) as a basic tool for devising the series of specific 
procedures required for complete reduction of the Norris 
images. Figure 2 provides a flow chart of the essential ones 
and how they proceed automatically or with interactive 
control by user, but more details on some critical points of 
our method are provided here. 

Primary extraction of data was achieved by extract 1, 
with in particular two important steps to notice: 

a) Cosmic rays 

High intensity hits (mostly due to electrons) have been re¬ 
moved by local detection (rather than from a comparison 
of 2 exposures) over boxes of 3 x 3 pixels using the rcosmic 
command, based on a median filter with relative thresh¬ 
old and no inclusion of the central pixel. Care has been 
taken not to overcorrect for cosmic ray hits in choosing 
the threshold level, which would result in negative arte¬ 
facts and hence a loss of useful signal, especially when hits 
occur on a steep gradient of intensity in the spectrum. So, 
weak intensity hits (mostly due to muons) frequently re¬ 
main unaffected by extract 1 , but they can be removed 
manually in the last stage of reductions using CUMUL 

b) Stray-light background 

This was fitted in the traditional way as the lower en- 
veloppe to the intensity distribution of fibers in the astro¬ 
nomical and mean dome-flat images. A median filter of 3 
pixels in x by 33 pixels in y was first applied and then mini¬ 
mum intensities found in boxes of 64x64 pixels were fitted 
with a 2D cubic spline. Two iterations were performed 
to improve the overall accuracy of background determina¬ 
tion. Given that the mean spacing between fibers is 12 — 13 
pixels on Norris frames, this technique has proven fairly ef¬ 
ficient in general, except when some fibers were assigned 
to very bright programme stars (H w 13—14), or more sig¬ 
nificantly for exposures taken close to the bright globular 
cluster Messier 92 (see Sect. 2). 

The method used for correcting the geometrical distor¬ 
tion consisted basically of four steps: 



EXTRACTl 

- converts FITS data into MIDAS BDF images 

- extracts images to useful size 2048 x 2048 pixel 

- subtracts electronic offset 

- removes cosmic ray hits (except for FeAr frames) 

- computes average files for FeAr and dome-flats 

- interpolates and subtracts background stray-light 

_I_ 

CALDIS 

- applies distortion test params to mean FeAr (DISTO_XY.exe) 

- fits degree-1 polynomials to FeAr speetra seleeted by user 

i 


' - user cheeks output dispersion manually j 
I - then modifies params and reruns CALDIS... ' 


EXTRACT2 

- applies final params to astronomical image and mean dome-flat 

_i_ 

CALIB 

- user selects useful columns on each spectrum of astronomical image 

- automatic column averaging for the 3 types of frames 

- automatic line wavelength-tuning on [OI] 5577 ==> ID spectra 


77 ^ 

- user cheeks automatic fitting of spectrographlc 
focus parameters (FORTRAN module) later used 
by FNDFIB for sky-background interpolation 


I 


FNDFIB 

- normalizes ID-speetra of sky-fibers by ID-flats 

- inserts norm, speetra at initial positions of sky-libers in a 2D-frame 

- interpolates 2D-frame row by row (SPFNDFIB.exe) ==> 2D-sky 
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CORSKY 

1 

' - user checks quality of ID-difskies, then possibly: i 

- averages useful columns of 2D-sky —> ID-skles 

1 - modifies set of sky-fibers and reruns FNDFIB... , 

- normalizes astronomical ID-spectra by ID-flats 

1 

1 

1 

1 

1 

1 

1 

1 

1 
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1 

1 

1 

1 
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1 
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J 

- adjusts OI 5577 width of ID-skies and normalized ID-spectra 

- subtraets ID-skles to normalized ID-spectra 

1 

- corrects astro, spectra for atmosphere and instrument transmittanees 

- user can minimize: 

A) airglow residuals (adjust sky faetor ~1) 

B) 02 + H20 absorptions (adjust airmass) ==> ID corrected spectra 

- computes differential sky-fiber residuals ==> ID difskies 

1 


I 


CUMUL 

- user can remove residual artefaets on eaeh ID-correeted spectrum 

- automatic averaging of exposures ==> ID output spectra 


Fig. 2.— Flow chart of the software package. Specific fortran subroutines (compiled in midas) called by some 
procedures are indicated. Dashed arrows refer to tests (frequently iterative) performed by user. 




















1. start from a blank output image (01) 

2. apply the geometric distortion algorithm to 01 pixel 
coordinates xy using crude estimates of initial pa¬ 
rameters, and get distorted pixel positions x'y' 

3. fill the 01 with intensities interpolated at positions 
x'y' of the mean FeAr calibration image 

4. test for residual distortions in the 01, and iterate on 
parameters until satisfied. 

Steps 1 to 3 are performed by the CALDIS procedure with 
calls to the disto_xy procedure, a modified version of the 
standard rebin/rotate command for image rebinning, 
the core fortran subroutine of which (rotait) is imple¬ 
mented with formulae given above and the set of model 
parameters (see Appendix B) stored in a special keyword 
for calls to disto_xy. The user is then prompted: (i) to 
choose a central fiber with good S/N ratio; (ii) to identify 
2 reference lines (Am 4132 A and An 8521 A) for tempo¬ 
rary linear wavelength rebinning; (iii) to select a number 
of fibers (typically 50) with good S/N ratios and well dis¬ 
tributed over the whole field. CALDIS then takes averages 
of useful columns for each selected fiber, adjusts Gaussian 
profiles to all calibration lines (typically 25), fits degree-1 
polynomials to the dispersion, and plots calculated wave¬ 
length differences vs. calibration wavelength, so that the 
user can eliminate any unreliable lines. Finally, the dis¬ 
tribution of mean dispersion is plotted vs. fiber position, 
and all data useful for the user’s analysis of the residual 
distortion in step 4 are stored in a series of tables and 
descriptors. 

Step 4 usually was the most difficult part of the data 
reductions and consisted in a thorough examination of the 
corrected FeAr image, with a variety of checks using either 
standard MIDAS commands or various procedures specially 
devised for determining residual trends, followed by deci¬ 
sions as to which way and by how much the parameters 
were to be modified. (We do not dare to detail here the 
whole set of tests applied, since they depend strongly on 
the underlying package used for image processing). 

Another critical step in data reductions consisted in 
carefully checking the quality of the 2D-sky interpolated by 
analytical modeling of the local PSF, as described above. 
The process was iterative in most cases and based on vi¬ 
sual inspection of the sky-subtracted ID-spectra obtained 
for all fibers after application of the GORSKY procedure 
(Fig. 2). As is commonly observed in deep spectroscopic 
surveys, some of the assigned sky fibers can then appear 
polluted by weak sources and must be removed from the 
set of fibers used for deriving the 2D-sky (serendipitous ev¬ 
idence of unexpected sources of interest are not uncommon 
in this respect). Conversely, some of the fibers ascribed to 
programme sources actually can show zero signal once sky- 
subtracted and hence should be used as true sky fibers in 


the next iteration (two iterations were generally sufficient 
for our data). 

The very final step consisted of averaging the two expo¬ 
sures normally acquired successively on a given field (this 
is undoubtedly the stage of reductions prefered by most 
observers!) using the CUMUL procedure, possibly after the 
user has replaced spurious artefacts on each spectrum by 
linear interpolation over as few pixels as possible (such 
artefacts may be due to faint cosmic rays incompletely re¬ 
moved by extractI, or more frequently to strong airglow 
lines such as [Ol] 5577 A and 6300 A). 

4. Performance summary 

A number of critical points have already been mentioned 
in sections above, with recommendations sometimes given 
for improvements to the similar methods now in use or de¬ 
velopment elsewhere. So, in this last section let us concen¬ 
trate on more specific aspects together with quantitative 
indications of the performances attained by us in correct¬ 
ing the geometrical distortion and modeling the variations 
of local PSF. 

a) Geometrical distortion 

Uncorrected residuals in the distortion can be quantified 
in two ways: (i) transverse residual distortions vs. fiber 
position X on the CCD were generally measured as < 0.2 
pixel during final examination of FeAr images corrected by 
CALDIS (step 4 of Sect. 3.3), consistent with relative varia¬ 
tions of < 5 X 10“® observed in plots that were considered 
satisfactory of the mean dispersion vs. x ; (ii) velocities 
derived from well-separated lines over the spectral domain 
for stars (absorption lines) and galaxies (narrow emission 
lines) generally show variations of < 30km/s, quite suit¬ 
able to the needs of our extragalactic program. 

It has been shown in Sect. 2 that the velocities derived 
for a series of galactic stars and also for 3 stars around 
the globular cluster M92 indicated a low systematic error, 
consistent with reasonable correction of the distortion, and 
with rms errors of ~ 25 — 30km/s. This value is similar 
to the rms internal error per line for our spectra with high 
S/N ratio, and also consistent with the ~ 35km/s rms 
dispersion observed in the differential velocities obtained 
for a series of 8 galaxies for which 2 or 3 different spec¬ 
tra are available (due to overlaps between different sub¬ 
fields observed over the 3 years of follow-up). Based on 
a comparison with observations performed by the referee 
(Donald Hamilton, private communication) using the Nor¬ 
ris spectrograph with a 1200 line/mm grating (instead of 
300 here), our 25 — 30 km/s rms error is also consistent with 
a factor of 2 improvement on the accuracy of velocities, as¬ 
suming the same S/N ratio of data. Such accuracy is of 
great importance for studies now in progress concerning 
the nature of the stellar objects with UV-excess detected 
by FOG A, and of course it results directly from our method 
for correcting the global distortion of the spectrograph. 



b) PSF modeling 

Ideally, a major improvement of our method concern¬ 
ing the model PSF would have consisted in using a 2D- 
polynomial fit to CCDlS’s true shape (see Sect. 3.2), but 
for various reasons this was not possible when the re¬ 
ductions were performed. Figured is a contour plot re¬ 
cently obtained for the calculated difference between: 
(i) the width of the PSF that would result from the 
bump shape itself; and (ii) the width resulting from an 
oblate paraboloid similar to typical fits derived for w(x, y) 
(though of course excluding the proper contribution of 
the camera lens to the focal plane curvature), i.e. us¬ 
ing a locus of best focus defined by i?p = 900 pixels and 
hy = 1.13 (dashed ellipse). Variations in the width of the 
PSF vs. defocus have been calculated using an effective 
focal ratio of 2.7 (according to numerical simulations) for 
Gaussian monochromatic beams exiting from the camera 
optics, instead of ~ 2.0 optically. 



0 10 20 30 40 50 


Fig. 3.— Contour plot of the difference between the true 
width of the local PSF due to the bump in CCD13 and 
an oblate paraboloid similar to typical ones derived from 
analytical modeling (Sect. 3.2). Contour levels are in pixel 
units and range from —0.45 (dark) to 4-0.60 (light) in steps 
of 0.15 pixel {zero contour level is fatter). CCD xy coordi¬ 
nates are in mm. The dashed ellipse shows a typical locus 
of best focus with Rp = 900 pixels and hy = 1.13, along 
which the PSF is ~ 3 pixels FWHM. The x coordinate of 
fibers used for recording the spectra of galaxies shown in 
Fig. 4 are indicated by arrow heads, with galaxies labels at 
the top of figure (red limit of spectral domain), and related 
comments in Sect. 4b. 


The contour levels show that the width of the model 
PSF may have been in error by as much as 4-0.5 pixels 
(lower right corner) and —0.6 pixels (center left), i.e. < 
20%, but in very small areas of the field. However, that 
i?p and hy are physically related was not understood when 
reductions were made, and slightly erroneous values of hy 
were sometimes used. This has certainly contributed to 
the moderate success observed in the subtraction of the 
infrared sky-background for some spectra, even with the 
1997 version of the package and reduction method. So, we 
strongly recommend the use of more realistic analytical 
approximations to w{x,y) for modeling other instruments 
whenever possible. 
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Fig. 4.— Examples of progress from year to year in the ac¬ 
curacy of geometrical correction and sky-subtraction for 3 
galaxies, each observed twice with the Norris spectrograph. 
Letters (A, E, F, O) in front of FOCA’s ID numbers denote 
subfields, and years of observation are indicated. Intensi¬ 
ties have been offset for presentation, but true values of 
continua around 6500 A are: w 15ADU for IDs. 813 and 
856, and w 85 and 150 ADU respectively for spectra E595 
and 0595 (this latter has been rescaled to the mean inten¬ 
sity of E595 before offsetting, so as to show spectral fea¬ 
tures with comparable intensities). A minimum sky con¬ 
tribution of w 25 ADU was typically subtracted around 
6500 A. See Sect. 4 for comments on residual artefacts in 
the infrared or at the UV-cutoff of the spectrograph’s spec¬ 
tral sensitivity. 

In any case, the unoptimized method we have used has 
given satisfactory results as is shown by Fig. 4, a plot of 6 
spectra obtained for 3 of the 8 galaxies mentioned above 
with low to moderate continuum intensities. These se¬ 
lected spectra provide examples of the progress experi¬ 
enced over the years in our understanding of the Norris 
system, and show that the sky-subtraction accuracy is es¬ 
sentially dependent on it, and more discretely on the ac¬ 
curacy of PSF modeling: 




1. the 2 spectra obtained one year apart for #813 were 
recorded at the same x position (Fig. 3), a region 
where residuals between the true shape of CCD13 
and the model fit are near minimum. So, the much 
better spectrum obtained in 1997 (especially above 
7000 A) is consistent with a globally better fit to 
the distortion, since with a radius of best focus 
i?p ~ 1086 pixels in 1997 (instead of « 745 in 1996), 
a much better fit to the local PSF is expected at the 
blue and red limits as mentioned in Sect. 3.2. Note in 
conjunction the very low intensities of the observed 
continua (« 15 ADU) for #813 and 856, to be com¬ 
pared with the minimum sky contribution (i.e. the 
pseudo-continuum at a resolution of about 10 A) of 
« 25 ADU typical around 6500 A 

2. #856 is also a weak continuum galaxy, but observed 
with 2 different x positions one year apart. The later 
A856 spectrum is far better than F856 of 1996, but 
the sky subtraction was less accurate for A856 than 
for F813 in 1997 (though i?p was nearly the same in 
both cases), because the hy factor was erroneously 
fixed at 1.14 for A856, as mentioned earlier 

3. #595 is a galaxy with recorded intensities much 
higher than for the previous cases. The 0595 spec¬ 
trum taken in 1996 benifited from much better mod¬ 
eling of geometrical distortion, and though it was 
recorded at a position where gradients in the PSF are 
a maximum, it shows a low level of residual “grass” 
above 7800 A, while the E595 spectrum taken in 1995 
appears badly corrected above 7200 A despite its op¬ 
timal position on the CCD. 

Another way to improve the accuracy of our sky- 
background subtraction would have consisted in position¬ 
ing the sky fibers as uniformly as possible in the output 
focal plane, so as the row-by-row interpolation described 
in Sect. 3.2 would be optimally constrained. However, this 
was not really the case for our observations, since the 
sky fibers were simply placed in areas of telescope’s fo¬ 
cal plane void of programme sources, partly because of 
mechanical limitations proper to the Norris system, but 
mostly because optimization of their output distribution 
would have required a great effort planning the setups. 

Concerning the low S/N ratios and obvious systematic 
trends obtained at the blue limit of our spectral domain, 
they result essentially from a combination of: (i) a marked 
drop in the overall transmittance of the system for wave¬ 
lengths shorter than 4000 A; (ii) an even more marked drop 
in the spectral flux intensity of dome-flats because of their 
intrinsically very red colour; and (iii) the inadequacy of the 
instrumental spectral response derived from spectra taken 
of the calibration star, mostly because of seeing-dependent 
factors. 

Let us also mention that a marked fringing above 8000 A 
has been sometimes reported by observers using CCD13, 


but no such effect was conspicuous in our Norris images, 
though good spectra with high S/N ratio at such wave¬ 
lengths have been obtained for a series of bright pro¬ 
gramme stars. 

Finally, we have found the Norris spectrograph a pow¬ 
erful! instrument, though it is not often used. With the 
method of reduction described in this paper, the overall 
percentage of success rate for identifying the nature of the 
UV-sources detected by FOCA around Abell 2111 has been 
as high as 95% globally (against 60% using standard tech¬ 
niques as tested in 1995), an excellent performance given 
the dominant contribution from galaxies with blue magni¬ 
tudes in the range 18 to 21. 

We are greatly indebted to: Christopher Martin (at Cal¬ 
tech) for the nice opportunity of observing with the “Big 
Eye” at Palomar Mountain; and Todd A. Small (now at 
Caltech) for his efficient assistance during the three ob¬ 
serving runs, critical data on the shape of CCD13 and 
general information on the Norris spectrograph. We also 
wish to thank: The Caltech and Palomar engineers for 
their support and most especially Eric Bloemhof; Antoine 
Llebaria at LAM for his creation of the fortran sky- 
background interpolating subroutine SPFNDFIB, which had 
a decisive impact on the overall success of our package; 
Veronique Cayatte and Pierre North at ESC for fruitful 
discussions during preparation of the giraffe software 
package; WilliamTobin (University of Canterbury, NZ) for 
revision of the English of this paper; and Donald Hamilton 
(the referee) for a pertinent estimate of the improvement 
in velocity resolution achieved by our method, in addition 
to his thorough analysis of the manuscript. 
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A. Derivation of the AnBn parameters 

Adopt: 0 = CiCA' the position angle of point A' a distance p from center C in the ideal focal plane; x = CGCi the 
angular distance of Ci from C as seen from grating’s center; and angle rj = CCiI, such that: 

tanx = tan i sin w, 

cos ?7 = sin i cos w, 

sin?7 = cos i cos X- (Al) 

The following relationships apply to spherical triangles CiCA' and CiF'^^A': 

X = pcos9, 

y = psinO, (A2) 
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sin:/?' = sin(GGA') j^sin 77 sin 0 cot(GGiA') + cos? 7 sinl 
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The two terms in brackets of Eq. 3 can then be expressed as functions of useful variables only: 

cos 1 / 3 ^ cose' = cos(GiGA') 

= cos X cos(CGA') + sin x sin(CGA') cos 0 
_ cos X + {x //) sin X 
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from which the Bn parameters of Eq. 4 are derived: 
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B. Set of model parameters for geometrical correction 


We detail here the nature of the adjustable parameters only (i.e. excluding the chromatic term K\, see Sect. 3.1), and 
comment briefly on their values and usefulness in some cases. The 15 parameters used in the 1997 version of the package 
were classed into four groups corresponding to: 

1) the fiber-slit 

SLOP tangent of the angle between the slit and plane PGF, hence y' = y-|-SLOPx(a; — Xc) 

TILT tangent of inclination in this plane 

2) the grating 

INCL angle i. Found cs —0?2 in 1996, but fixed to zero in 1997. 

OMEG angle u. Found cs —19° in 1996, but fixed to zero in 1997. 

BETA angle /?' 

LDAC central wavelength Ac 

The anomalous values observed for incl and OMEG in 1996 probably resulted from accidental mis-positioning of grating’s 
mount during adjustment of the spectral domain. 

3) the camera lens 

Xc , Vc coordinates of optical axis 

FOBJ paraxial focal length /c, hence true focal length / = /c-I-tiltx (x — Xq) 

On distortion coefficients (n < 4) 

The values derived for fobj revealed sensitive to temperature in the dome, and roughly consistent with thermal expansion 
factors of common metals. 

4) the CCD 

ROTA y-axis orientation relative to meridian plane CCF. Year dependent. 

PENT accounts for inclination in this plane, hence y' = y x (1-|-pent). Found irrelevant > 1995, fixed to null. 

So, though only 12 active parameters were used for geometrical modeling of the Norris system in 1997, the formalism 
developed in Sect. 3.1 and Appendix A allows treatment of more complex situations for other instruments in which 
parameters such as incl and OMEG differ significantly from zero. 



